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ABSTRACT 


The neuron has two processing functions, i.e. aggregation and activation 
function. The aggregation of input to the neuron is performed through weighted sum. 
The aggregation of input is passed through activation function to generate the output of 
the neuron. The performance of the neural network depends upon the characteristics of 
the neuron. The total number of connecting weights among neurons, the optimization 
algorithms and their parameters constraint the learning time for the neural networks. 

This thesis deals with study of conventional back propagation algorithm for 
learning of neural networks having neurons with different types of activation functions. 
The study reported here includes the prediction of short-term power demand, and 
interest rate forecasting. These two prediction problems have been solved using 
conventional neural network architecture and non-conventional architecture of the 
neural networks. 

The results obtained for prediction of either power demand or interest rate 
demonstrate directly the quality of prediction as function of activation function. The 
conventional architecture produces relative better results compared to non-conventional 
architectures for power demand forecast, whereas recurrent neural network performs 
better for interest rate prediction compared with other reported architectures. 
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Chapter 1 

Introduction 


The method for processing information as understood in human brain is through 
neurons. These neurons are interconnected massively in parallel [1-4], A schematic of the 
same has been shown in Fig. 2.1. The mathematical model of a neuron is as follow: 

r hi \ r N \ 


y,=f I 


w,x, + w,. 




w,x, 


where x „ = 1 


. '=1 


y V'=o y 


where, 

w, = weight assigned to input 
X, - input to neuron 
y, == output of neuron 
w„ = threshold for neuron 

There is no restriction on w, . Weight can be static, probabilistic, dynamic, fuzzy, 

and stochastic. Weights are defining decision boundaries in Artificial Neural Network 
(ANN.), 'fhese decision boundaries may be time dependent or independent. The 
dimension of the decision boundaries is a direct function of number of inputs to the ANN. 
Non-linear models for controls; pattern recognition, optimization and regression require 
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non-linear terms to depict the relationship between input and output. This is achieved 
using a sigmoidal function as shown in Fig. 2.2. The sigmoidal function output (Y^) is 
defined as 

Y = 

G = gain of sigmoidal function and 
P = abruptness/slope indicator 

The output ot sigmoidal tunction is 0.5 for y, = 0, G = p =1.0, and y, increases for 
same values of G and p the Y, became zero. 

There are large numbers of learning methods for Artificial Neural Network [5]. 
Learning means determining (i) interconnection among various neurons and (ii) strength 
of interconnections. This process also known as memorization. At this point, a brief 
introduction of supervised and unsupervised learning would be helpful. Unsupervised 
learning, also known as self organisation, does not require an external teacher and relies 
only upon local information. This type of learning is used to generate classification of 
data presented to ANN. Learning algorithms uses “follow the leader” approach. 
Vigilance parameter and metric function control clustering. 

Supervised learning needs an external teacher and knowing before hand the target 
values performs the error correction. The error is defined as follows: 

E=i(0,-7:) 

;=l 

Where, 

0 , = output of ANN 
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T, = target value (desired output) 

E , = Error 

Supervised learning is further classified as: (i)structural learning (output is independent 
of past values) and (ii) temporal learning (output depends upon past history). 

The second type supervised learning is employed for Short-Term Load 
Forecasting (STEF) and Financial Forecasting. 

Artificial Neural Networks (ANNs) have been widely applied to obtain solution to 
prediction problem [7]. The ANNs have also been tested for prediction problems such as 
power demand and interest rate [10]. Variants of ANNs used for predictions and control 
has been reviewed and reported in literature [8]. The literature survey showed that the 
major emphasis to develop the variants of ANN is on its learning algorithms. Further, it 
has also been proposed in recent papers [11-15] that learning algorithms for ANNs can be 
made efficient by incorporating new neuron models [6]. The development of neuron 
model not only reduces the complexity of architecture, learning time but also contributes 
in reducing hardware requirements. 

The study reported in thesis has been carried out from viewpoint that can one 
achieve advantages of new neuron model by appropriately adjusting the thrc'holding 
functions of the neurons. To investigate the influence of thresholding functions on the 
quality of prediction the following problem has been defined. 

1.1 Problem Definition 

The standard feedforward neural network is generally developed using 
backpropagation algorithm (BPA) of either first order or second order. The neuron which 
forms the basic unit of ANN is realized by aggregation function and thresholding 


3 



function. The most commonly used aggregation function is weighted sum. which is 
passed through the thresholding function i.e. sigmoidal function (most commonly used). 

In the literature survey, author has realized that influence of thresholding function on the 
performance ot ANN has not been fully justified, further all thresholding functions have 
not been evaluated tor a given problem. With the objective of evaluating the influence of 
thresholding function the following tasks have been set forth 

(i) Study of influence of thresholding function for conventional ANN models for 

predicting STLF (Short Term Load Forecasting) and interest rates. 

(ii) Study of influence of thresholding function for non-conventional ANN models for 

predicting STLF (Short Term Load Forecasting) and interest rates. 

1.2 Organization of Thesis 

A brief introduction of neuron model along with its limitations has been discussed in 
Chap ter I . 

In chapter 2, the standard backpropagation neural network has been studied to predict the 
power demand and interest rale with various thresholding functions. 

In chapter 3, the non-conventional neural network has been tested to find the best modal 
for prediction of power demand and interest rate with various architecture and 
thresholding function. 

Conclusions are given in chapter 4 and this chapter also includes the future scope in this 
field. 
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Chapter 2 


Conventional Neural Network 
Models for Prediction 

2.1. Introduction. 

Artificial Neural Networks (ANN) have been used in literature for prediction 
of Short- Term Load Forecasting (STLF) [12], and financial forecasting [15]. Both 
problems have been solved using back propagation algorithm (BP A) and its variants. 
However basic neuron model used to solve above mentioned problems consists of 
weighted sum of all the inputs as aggregation function and sigmoidal function as the 
thresholding function. It is believed that aggregation function thresholding function 
play an important role for input and output mapping of data. The study reported in 
this chapter demonstrate influence of thresholding function upon the quality of 
prediction, using standard BPA for both problems stated above. 
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2.2. Artificial Neural Network Structure. 


The basic building block of ANN is a neuron (depicted in Figure 2.2 as a 
circle). The neurons are connected by weights, (depicted as lines) which are applied 
to values passed from one neuron to the next. A group of neurons is called a slab. 
Neurons are also grouped into layers by their connection to the outside world, as 
shown in figure 2.1. For example, if a neuron receives data from outside of the 
network, it is considered to be in the input layer. If a neuron contains the network’s 
predictions or classifications, it is in the output layer. Neurons in between the input 
and output layers are in the hidden layer(s). A layer may contain one or more slabs of 
neurons. 

2.2.1. Link 

A link is the connection or set of weights between the slabs or groups of 
neurons in a network. Each link can have an individual learning rate and momentum, 
and the weight can be fixed in a particular range as required. ^ 

2.2.2. Learning , 

The network “learns” by adjusting the interconnection weights between 
layers. The outputs the network is producing are repeatedly compared with the correct 
outputs and each time the connecting weights are adjusted slightly in the direction of 
the correct outputs. Eventually, if the problem can be learned, a stable set of weights 
adaptively evolves and will produce good outputs for all of the sample predictions. 
The secret to building successful neural networks is to know when to stop training. 
Too little training may not make the network learn the presented patterns while too 






much training can make it memorize the patterns and thereby losing the 
generalization character.ln this work, two types of learning are studied for ANN. i.e. 

(1) . Rotational :-This select training patterns in the order they appear in the 
Pattern file., and 

(2) . Random. This option randomly chooses the training patterns. 

2.3. Architecture of Artificial Neural Network. 

An ANN has input, hidden and output layers. The number of neurons in input 
and output are constrained by the number of inputs and outputs whose relationship is 
to be established, whereas the number of hidden layers and the number of neurons in 
each layer are to be decided by mapping requirements of the inputs and outputs. This 
is performed by trial and error during training phase. Once the number of hidden 
layers and the number of neurons in each layer have been finalized, the model is 
tested on available data to avoid under or over training of the network. 

A total of P sets of training patterns are assumed to be available. Inputs of 
these patterns are imposed on the input layer. The ANN is trained to the 
corresponding target vector i.e. the set of outputs. The training continues until a 
certain stop-criterion is satisfied. Typically, training is halted when the average error 
between the desired and actual outputs of the neural network over the P training data 
sets is less than a predetermined threshold. The training time required is dictated by 
various elements including the complexity of the problem, the number of data, the 
structure of network, activation function, hidden neurons, and the training parameters 
used. 
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2.3.1. Architecture of Standard Back-Propagation Networks. 

Following architectures of ANN have been used for standard BPA. Neural 
network with each layer connected to the immediately preceding layer with one 
hidden layer.as depicted in Figure 2.3., similarly with two hidden layer and with three 
hidden layer. 



Figure 2.3: Block diagram of ANN with a Hidden Layer 
2.4. Activation Function 

The hidden layer produces outputs based upon the sum of weighted values 
passed to them. So does the output layer. The way they produce their outputs is by 
applying an “activation” function to the sum of the weighted values. The activation 
function, also called the threshholding function, maps this sum into the output value, 

I * 

which is then “fired” on to the next layer. Although the logistic function is the most 
popular, there are other functions which are also used. 

2,4.1. Logistic (.Sigmoid logistic) 

This function is found to be useful for most of the cases. It maps values into 
the range (0.1 ) as shown in Figure 2.4. 
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logistic: 


t'(x) = 


1 


(1 + exp(-x^) 


symmetric_logistic: 

n 

f(x) = 


(1 + exp(-x)) 


scale [-1.1] 



Logistic Symmctnc Logistic 


Figure 2.4: Logistic and Symmetric logistic activation function. 

2.4.2. Linear 

Use of this function is generally limited to the output slab. It is useful for 
problems where the output is a continuous variable. It sometimes prevents the 
network from producing outputs with more error near the min or max of the output 
scale. In Fig. 2.5 Linear function is depicted, 
linear function 
f(x) = X 
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1 


1 

0 
-] 

_2 

2.4.3. Tanh (hyperbolic tangent) 

It is sometimes better for continuous valued outputs especially if the linear 
function is used on the output layer. 

f(x) = tanh(x) 

Its another variation is defined as shown in figure 2.6. 
f(x) = tanh(1.5x) 



Fig 2.5: Linear activation function. 



UUlh 




OJ 

0 

*'-2 -U -I 0 OJ5 i * 

tanhlS 

Fig. 2.6: Hyperbolic Tangent activation function 

2.4.4. Sine 

If it is used it in the first hidden layer then the inputs are scaled into the range 
[-1.1] and if used in the output layer, output is scaled into the range [-1,1] as shown in 
figure 2.7. 

f(x) = sin(.x) 




stoe 


Fig.2.7: Sine activation function 
2.4.5. Gaussian 

This function is unique, because unlike the others, it is not an increasing 
function. It is the classic bell shaped curve, which maps high values into low ones, 




and maps mid range' values into high ones. It is used it in the hidden layer, and 
standard logistic function in the output layer. Output layer as shown in figure 2.8 
Gaussian: 

f(.v) = e.\p(-x-) 



gaussian 


Fig.2.8: Gaussian activation function 
Gaussian-complement: 


f(x) = 1 -e.xp(-x-) 



fauisiauQ cocnphment 


Fig 2,9: Gaussian compliment activation function 






2.5. Weight Updation Schemes. 


The BPA algorithm is based on steepest descent method for solving non- 
linear optimization problem. The details of the algorithm is reported in the literature 
[9]. Generally learning rate and momentum factor influence the convergence of the 
algorithms. 

2.5.1. Learning Rate 

Each time a pattern is presented to the network, the weights leading to an 
output node are modified slightly during learning, in the direction required to 
produce a smaller error the next time the same pattern is presented. The amount of 
weight modification is the learning rate times the error. For example, if the learning 
rate is 0.5, the weight change is one half the error. The larger the learning rate, the 
larger the weight changes, and the faster the learning will proceed. Oscillation or 
non-convergence can occur if the learning rate is too large. 

2.5.2. Momentum Factor. 

Large learning rates often lead to oscillation of weight changes and learning 
never completes, or the model converges to a solution that is not optimum. One way 
to allow faster learning without oscillation, is to make the weight change a function 
of the previous weight change to provide a smoothing effect. The momentum factor 
determines the proportion of the last weight change that is added into the new weight 
change. 
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2.6. Parameters Used for Selection of Best Result 
2.6.1. R Squared: - 

R squared, the coefficient of multiple determination, is a statistical indicator. 
A perfect fit would result in an R squared value of 1, a very good fit near 1, and a 
very poor fit near 0. If our neural model predictions are worse than we could predict 
by just using the mean of our sample case outputs the R squared value will be 0. The 
formula for R squared is the following. 

1 SSIi 

R^ = 1 - 

SSyy 

where, 

SSE = I(y-y)^. 

SSyy =I(y-y)' ^ 
y = the actual value, 
y = the predicted value of y. and 
y = the mean of the y values. 

2.6.2. Correlation Coelficient (r): -- 

This is a statistical measure of the strength of the relationship between the 
actual vs predicted outputs. The ‘r’ coefficient can range from -1 to +1. The closer r is 
to 1 the stronger the positive linear relationship, and the closer r is to -1, the stronger 
the negative linear relationship. When r is near 0. there is no linear relationship. 
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2.7. Short Term Power Demand Prediction 


A power system can be viewed as an interconnection of three main 
subsystems viz. generating unit, transmission and distribution network and loads. The 
modelling of generators and transmission and distribution networks for different types 
of studies has become almost standard. Whereas the composite load on a system bus 
consists of large number of individual loads having different responses to system 
operating conditions and disturbances. The proper load modelling is, therefore, 
important for achieving accurate system study results. 

A precise short-term power/load forecasting is essentially for monitoring and 
controlling power system operation. The hourly load forecast with leading time up to 
one w'eek in advance is necessary for on-line solution of scheduling problems. A 24- 
hours load forecast is needed for successful operation of a power system. One-hour 
forecast is important for on-line real time conttol and security evaluation of a large 
power system. S>stem load forecasting is an essential operation in power system 
control centres. Short-term load forecasting (STLF) is one of the most important 
procedures in the real-time control of power generation and efficient energy 
management systems. It is used for establishing the power station operation plan and 
the unit operation plan, together with generation and spinning reserve planning of 
energy e.xchange. In other words, the optimal utilization of generators and power 
stations is completely dependent upon the accuracy of load forecasting. 

The time interval of load forecasts varies from few seconds to few minutes 
(very short term), half to few hours (short term), few days to few weeks (medium 
term) or few month to a few \'ears (long term forecasts). Very short and short-term 
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forecasts are normally used for real time control actions such as security control and 
load despatch etc. In load prediction, weather has an important impact and needs its 
modelling with system load. The features that can be taken into account as input 
causal factors in the short term forecasting problem are as follows: 

1 . Temperature of the current hour 

2. Average temperature of the previous day 

3 . Maximum temperature of the current day 

4. Minimum temperature of the current day 

5. Wind velocity 

6. Rain for the past 3 hours 

7. Rain for the past 24 hours 

8. Sky condition indicator 

9. Day of the week indicator 

10. Wet or dry day 

1 1 . Current hour. 

It is generally observed in any electric load utility that all the parameters are 
not recorded, so it is not physically possible to include all these in the prediction. 
Therefore, the more important ones are included such as day of the week, hour of the 
day and the previous hour of the day and the previous hours data etc. 

In fact, the varying nature of load is random and load prediction requires the 
modelling of time series representing these variations. Since it is difficult to evolve a 
clear cut mathematical model for these random variables, the conventional methods 
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are unable to provide accurate results apart from meeting the speed requirement. To 
overcome this difficulty, ANN based models are suggested. 

2.7.1 Neural Network Model for STLF Using Standard BPA. 

2.7.1. 1 Statistical Analysis of data: 

Statistical analysis of data is the primary step needed in case of training the 
system with every feature of the data so as to make network to catch up with the 
trend of the data. The data analysis reveals that load variation in all the days of the 
week follows similar trend except for some small disturbances. The load has the 
lowest of its peak for the first hour of the day to sixth-seventh hour of the day and 
then it raises to its peak by the ninth hour of the day. The peak is almost maintained 
till the twenty first hour of the day and then falling to its lowest value. One day data 
variation is shown in Fig. 2. 1 0. The data analysis gives the intuition that at least three 
past histories of the same day is required for catching up the trend of the day. It is 
also required to take into seasonal effects by considering the same hour load of 
previous one, two or three weeks. The data that is provided to the system is not 
having the information of the temperature. The effect of the temperature is 
considered by the past histories of the day and the seasonal effect with the help of 
past week histories. The temperature information will give prediction if there are 
abnormal changes within one or two hours. Therefore, compromise is made in 
between the data available and the accuracy wanted. 
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2.7.2. Approach rowards Problem: 

Alter the analysis of data, it is decided that the prediction requires data of three 
past hours and three past weeks of at that hour. Various inputs to the ANN are as 
follows: 

1 . One hour past load 

2. Two hour past load i 

3. Three hour past load 

4. One week past load of the same present hour at we have to predict load 

5. Two week past load of the same hour 

6. I'hree week past load of the same hour. 

7. 

2.7.3. Rc.sults 

The standard BPA approach has been applied to forecast the hourly electric 
load demands. The ANN multilayer structure has been trained using the back 
propagation technique, and got the following results as illustrated in Table (1). We 
studied 15 cases for various activation function (threshold) applied to the hidden 
layers and the output layers. 

For 3-layer neural networks the predicted results for the best training is found 
by applying activation function ’sine' to hidden layer and ‘logistic to output layer, as 
shown in figure 2.1 1. And the best prediction is found by applying activation function 
‘tanhl5’ to hidden layer and 'logistic' to output layer as shown in Fig 2.12. 
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TABLE (1) : SUMMARY OF STANDARD BACK-PROPAGATION NEURAL NETWORK RESULTS FOR STLF 




Predicted result for best training in 3-layers network With case No 



Hours 



prediction i 



3500 



With ^ ^-laver^ M * 

case iVo. 7 ^atwork 



NetWork Wifi 




< pueujBp peo-j 


Predicted result for best prediction In 5-layer network With case No. 



Fig. 2.16 





Fig. 2.17 






Fig. 2.19 




Activath 




Fig. 2.21 







Fig. 2.23 




hor 4-layer neural network the predicted results for both the best training and 
best prediction are found by applying activation function ‘tanh’ to the hidden layers 
and ‘logistic to the output layer as shown in Fig 2.13. 

For 5-layer neural network the predicted results for best training is found by 
applying threshold ‘Gaussian to the hidden layers and ‘logistic to the output layer as 
shown in figure 2.14, and for the best prediction is found by applying threshold ‘sine’ 
to the hidden layers and ‘logistic’ to the output layer as shown in Fig 2.15. 

2.8. Financial Forecasting for Interest Rate Prediction. 

1 he approach discussed for STLF for building neural network is applied for 
prediction of interest rates. We can take any financial time series process. For this, we 
have chosen interest rates, as represented here by the rates for 91- day Treasury bills, 
or so called r-bill, are quite volatile and non-linear, data are taken from [15] as 
shown in append i.x. 

2.8.1. Modelling of Interest Rates: — 

Interest rate is modelled based on an example from an article by Larrain 
(1991 )[7]. According to Larrain, following five factors account for roughly 90% of 
the variation in intere.st rates: - 

(1) Previous interest rates (or T-bill rates), 

(2) Real Gross National Product (GNP), 

(3) Consumer Price Index (CPI). 

(4) M2 nominal money supply (all cash in circulation and deposits in savings and 
checking accounts), 

(5) Personal Wealth (difference between personal income and personal consumption). 



I he basic data files contain over 20 years worth of quarterly data. In this 
problem not only the past history but also the above mentioned all the factors are 
considered. 

The system is modelled to take into account the data of past 20 years from 
1966 to 1985, i.e. 80 quarters of data points two more data points for the test file. The 
following combinations for pattern files have been taken: - 

(1) . The GNP & Interest Rates inputs use, the basic data set starts with the first 
quarter of 1966. 

(2) . CPI is to be delayed by one quarter relative to interest rates data, i.e., its starting 
point is the fourth quarter of 1 965, 

(3) . M2 money supply, and Personal Wealth data are delayed by two quarters relative 
to interest rates data and hence started with the third quarter of 1965, 

(4) . Since we w'anted to model the next quarter’s interest rate, hence we started the 
output interest rates one quarter later, i.e., the second quarter of 1966. 

The results of ANN modelling are shown in Figure 2.1. It is clear from the 
figure 2.24 that Neural Network is capable of modelling all of the non-linear 
fluctuations. 

2 . 8 . 2 . Predicting Interest Rate: 

The fundamental financial market characteristics change over a period of four 
to five years (Peters 1991 ) {7J. That is, the market “forgets” the influence of data that 
is more than five years old. For this reason, five-year data window i.e., each training 
set (window) contains 20 data points since we are taking quarterly data, are used in 
our problem. We look at 15 data windows, starting years being 1967 to 1981 and 





ending years being 1971 to 1985 F-.ach training set had 20 data points and the test .set 
has two more data points, i.e.. the prediction testing of the first as well as the second 
quarter of a next \ear immediately following the training data. Hence 15 patterns files 
(windows) has selected are gi\en in Appendix. In which each patterns file contain 22 
patterns whereas first 20 sets are lor training set and last 2 set for test set which we 
have to predict through the training network which is trained by training set. 

2.8.3. Results. 

1 he standard BFA approach has been applied to forecast the interest rate. The 
neural network is trained by taking only window- 1 patterns-data, and results are 
illustrated in lable (2). We studied 15 cases for various activation function 
(threshold) applied to the hidden layers and the output layers. 

I'or .7-layer neural network the best training result is found by applying 
threshold function ‘tanhl5‘ to hidden and ‘linear' to the output layer but in this case 
the predicted result is worst as given in Table (2), where the correlation coefficient is 
negative one. And be.st prediction is found by applying threshold function ‘tanh’ to 
hidden and 'linear* to the output layer as illustrated in Table (2) and shown in figure 
2.25. Similarly for 4-layer neural network the be.st prediction is found by applying 
threshold function 'symmetric kigisiic* to the hidden layers and ‘linear* to the output 
layer.as shown in lug 2.26. 

For 5-laycr neural network there is no best prediction result as shown in Table 
(2), where all cases have R-squared values is zero. 



TABLE (2) : SUMMARY OF STANDARD BACK-PROPA(; aTION NEURAL NETWORK RESULTS FOR FINANCIAL FORECASTING 
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Fig. 2.26: Best prediction of Interest rate on 4-layer Std. Neural Network. 






2.9. Conclusion. 


I he best inocicl for prediction of load demand turns out to be the 4-layer (6-9- 
9-1) standciid back-piopagution neural network, with threshold function ‘tanh’ in the 
hidden lajcr and logistic in the output layer. And for prediction of interest rate of 
the financial fbiccasting the best model is 3-la)’er (6-18-1) neural network with 
threshold funetiim 'tanh' in the hidden layer and ‘linear’ in the output layer. 



Chapter 3. 


Non-Conventional Neural Network 
Models for Prediction. 


In the last chapter the standard BPA has been studied to solve two problems 
i.e. Sl'LF and itueresl rate prediction. The major part of the study has been devoted to 
stud\' the innueiKC of the thresholding function and parameters effecting the 
convergence of BP.\ for given problems. Mowever, it was assumed that neurons are 
connected among nerghbo.unng layers only In this chapter, possibilities are explored 
for connecting neurons in dilTerent layers other than conventional connections i.e. 
Jump connections and Feedback connections etc. The comparison of mainly three 
types of neural nctvvtjrks has been carried out in the chapter. These neural neuvorks 
are the following: 

(1). Jump C'onnection Neural Networks. 
f2). Recurrent Neural Networks. 


(3). Ward Networks. 



I he above variations of ANN are applied to the problems of STLF and 
interest rate prediction and result is presented here. 

3.1. Jump C onnection Neural Networks. 

I his is the Hack 1 lopapatioii Neural Network with each layer connected to every 
previous Ia>ci. 

(a). VV ith ! hidden Ia>er as shown in figure 3.1. 



Fig .3.1: Block diagram ol dump connection with one hidden layer neural 
network 
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(b). With 2 hidden layers as shown in figure 3.2 



Fig 3.3: Bk 







3.1.1. Short I'erm Power Deniiiiid Prediction. 


3.1. 1.1. Results 

The best model in Jump connection neural network for STLF is 3-layer network 
which gives best training and prediction results compared to others as illustrated in 
Table (3). 

In 4-layer neural network best training results is found by applying threshold function 
‘Gaussian compliment’ to the hidden layers and ‘logistic’ to the output layer, but 
better prediction is found with threshold ‘tanhlS’ to hidden layers and ‘logistic’ to the 
output layer. 

In 5-layer neural network best training with threshold function ‘sine’ to hidden layers 
and ‘linear’ to the output layer, but better prediction is found with threshold function 
‘sine’ to hidden layers and ‘logistic’ to the output layer. 

Among the entire Jump connection neural network the best model is found 3-layer (6- 
18-1) with threshold function 'logistic' in hidden layer and output layer. The 
prediction results are shown in Fig 3.4. 

3.1.2. Interest Rate Prediction. 

3.I.2.I. Results 

t 

Following results are obtained on Jumpconnection neural network. In the case of 
interest rate prediction as illustrated in Table (4). 

In 3-layer network we found the best prediction with threshold function ‘Gauss 
comp.’ to hidden layer and 'linear' to the output layer. 

In 4-layer network, better training is found in case no 4 as in Table(A) where 
prediction is worst, and in case no. 15. the prediction is better but training is worst. 
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Fig.3.4: Best Prediction of STLF on 3-layer Jump Connection ANN. With case No. 
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Fig. 3.5: Best Prediction of Interest Rate on 3-layer Jump Connection ANN. 

With case No. 14. 


In 5-layer network better prediction is found in case no.9. where training is also 
reasonably good. 

It is observed that among all Jump networks, the 3-layer network predicts the interest 
rate with belter accuracy as in case no. 14. with threshold 'Gauss comp.' in the hidden 
layer and 'linear’ in the output layer as shown in Fig 3.5. 

3.2. Recurrent Neural Networks. 

Recurrent neural network is most important ANN for time series problem such as 
electric load forecasting, financial forecasting. There are three types of recurrent 
neural network as illustrated below 

(a). With feedback from input layer to input layer as shown in Fig 3.6. 





r ** ^ A J 



Fig. 3.6 





Fig3.7: Bloc 
laye 








(c). With feedback from output layer to input layer as shown in Fig. 3.8. 



Fig.3.8: Block diagram of Recurrent Neural Nehvork with feedback from Output 
layer to Input layer. 

3.2.1. Short Term Power Demand Prediction. 

3. 2.1.1. Results 

The results of recurrent neural networks are presented in Table (5). For first network 
as shown in figure 3.6, the best training is found in case No.l I, and best prediction is 
found in case No.2. For 2nd neural network as shown in Fig 3.7, the best training is in 
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Fig. 3.10: Best Prediction of Interest Rate on Recurrent Neural Net With case No 1 


case 7., and best prediction is in caseNo.4.for 3rd network as shown in figure 3.8, the 
training is in case 7., and best prediction is in caseNo.5. 

Concluding from all the above recurrent neural network the best model is as 
shown in figure 3.7 with threshold function "tanh’ to hidden layer and ‘logistic’ in 
output layer which gives best power demand prediction in recurrent network as 
shown in Fig 3.9. 

3.2.2. Interest Rate Prediction. 

3.2.2. 1. Results 

Interest rate prediction using recurrent neural networks is presented in Table (6). In 
first neural network (fig. 3. 6) the best prediction is with case No.l. In 2nd neural 
network (fig. 3.7) the best prediction is with case No.2. and in 3rd neural network 
(fig. 3.8) the best prediction is with case No.l 1 . 

From all above recurrent neural network the best model for prediction of Interest rate 
is in case No 1 with threshold function ’logistic' to hidden layer and ‘linear’ to the 
output layer, result are shown in Fig 3.10. 

3.3. Ward Neural Networks. 


There are three types of Ward neural network are used as follow: 
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(c). With 2 slabs in the hidden layer and a jump connection between the input 
and output layers as shown in Fig 3.13. 



Fig.3.13: Ward Neural Network with two slabs in hidden layer and Jump, 
connection 

3.3.1. Short Term Power Demand Prediction. 

3.3. 1.1. Results 

The results of power demand prediction are illustrated in Table (7), whereas. In first 
network (fig.3.1 1) the best training result is with case No 13. And the best prediction 
with -case -No. 8. For 2nd network (Fig.3.12) the best training and best prediction are 
with cases 6 and 8 respectively. For 3rd network (Fig.3.13) the best training and 
prediction are with cases 7 and 4 respectively 

From all above Ward neural network the best model for prediction of power demand 
is in case 7. with threshold function ‘tanh’ to hidden layer and ‘logistic’ to the output 
layer, as the best prediction is shown in Fig 3.14. 
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3.3.2. Interest Rate Prediction. 


3.3.2. 1. Results 

The Interest rate prediction on Ward neural networks are illustrated in Table 
(8), where in for 1st network (Fig.3.11) the best training and prediction are found 
with case No 4.. for 2nd network (Fig.3.12) the best training and prediction are with 
cases 14 and 5 respectively, and for 3rd network (Fig. 3. 13) the best training and 
prediction are with cases 1 1 and 1 respectively. 

From all above Ward neural network the best model selecting for interest rate 
prediction is in case No. 4 with threshold function "Gaussian" to hidden layer and 
‘linear’ to the output layer. 

3.4. Conclusion. 

The results obtained I’or prediction of power demand and interest rate through 
all architecture of non conventional neural network have been compared, and found 
the Recurrent neural network gives the best results for both the problem. For the 
short-term power demand prediction the neural network with feedback from the 
hidden layer to the input layer with threshold function ‘tanh’ to hidden layer and 
"logistic" to the output layer gives better prediction. Whereas for the Interest rate 
prediction -the neural network with feedback from the Input layer to the input layer 
with threshold function ‘logistic’ to hidden layer and ‘linear’ to the output layer gives 
better prediction. 

Recurrent neural networks have been successfully used in predicting both 
problem as stated above, because recurrent networks can learn sequences, this 



TABLE (8) : SUMMARY OF WARD NEURAL NETWORK RESULTS FOR FINANCIAL 




z 

H 

< 

U 

bi 

o 

b. 




3400 



Ward Network 


prediction 



Fig.3.15: Best Prediction of Interest Rate on Ward Network. With 



network are excellent for time series data. They have the slight disadvantage of taking 
longer to train. 

Recurrent network is the feedback neural network, this group of networks 
performs recall computation with feedback operational. These networks can be 
considered as dynamical systems and a certain time interval is needed for their recall 
to be completed. Feedback networks are also called recurrent networks. Whereas non- 
feedback network popularly known as feedforward system in neural network, has an 
one way data flow from input towards output. In non- feedback system the output 
does not depends upon the past history of the inputs. 

As stated above paragraph the feedback concept brought to neural network to 
improve reliability and operational performance as seen in the results of the recurrent 
neural network, which gives the best prediction compared to the non-feedback neural 
network. 
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Chapter 4. 


CONCLUSION AND FUTURE 
WORK SCOPE. 

4.1. Conclusion 

The short term load forecasting and financial forecasting, using Artificial 
Neural Networks (ANNs), are investigated in this thesis and the results are analysed. 
The Short-Term Load Forecast (STLF) plays an important role in the secure operation 
of a power system.. Accurate load forecast provides the system dispatchers with 
timely information to operate the system economically and reliably. The application 
of neural networks for financial forecasting and modelling has been very popular. 

The overall conclusion for both power demand prediction and interest rate 
prediction is selecting best model of ANN. For short-term power demand prediction 
the best model is suggesting 4-layer standard backpropagation neural network with 
activation function ‘tanh’ to the hidden layers and ‘logistic’ to the output layer. For 
interest rate prediction the best model is suggesting recurrent neural network with 
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feedback from input layer to input layer, with activation function ‘logistic’ to the 
hidden layers and ‘linear’ to the output layer. 

4.2. Future Work 

(1) The influence of various aggregation functions on the quality of prediction. 

(2) Influence of various optimizations along with different aggregation and 
thresholding function on the quality of prediction. 

(3) New Neural Architecture can be used to enhance the speed of Computation so that 
the on-line training and prediction can go simultaneously. 

(4) Use of second order learning imposed on new architecture may provide better 
accuracy along with fast result. 

(5) Hybrid Neural Networks is another possibility together with the new architecture 
which would improve the result as well as computation time and thereby reducing the 
cost of operation. 
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APPENDIX 



TRAINING FILE FOR SHORTTERM LOAD FORECASTING 


3hr 

2hr 

Ihr 

3week 

2week 

Iweek 

output 

3161 

3110 

3092 

2966 

3177 

2871 

2929 

3110 

3092 

2929 

2895 

3043 

2790 

2847 

3092 

2929 

2847 

2965 

3135 

2947 

2986 

2929 

2847 

2986 

3094 

3161 

2975 

2946 

2847 

2986 

2946 

3073 

3188 

2893 

3068 

2986 

2946 

3068 

3041 

3210 

2825 

3095 

2946 

3068 

3095 

2936 

3244 

2887 

3119 

3068 

3095 

3119 

3076 

3256 

2960 

3008 

3008 

3163 

3172 

2899 

3108 

2898 

2960 

3163 

3172 

2960 

3017 

3033 

2903 

2877 

3172 

2960 

2877 

2866 

2903 

2874 

2786 

2960 

2877 

2786 

2604 

2617 

2615 

2450 

2877 

2786 

2450 

2564 

2597 

2617 

2508 

2786 

2450 

2508 

2522 

2575 

2607 

2437 

2450 

2508 

2437 

2591 

2584 

2568 

2404 

2437 

2404 

2449 

2778 

2948 

2712 

2496 

2449 

2496 

2834 

3194 

3298 

2951 

3031 

2496 

2834 

3031 

3183 

3128 

3023 

3126 

2834 

3031 

3126 

3163 

3191 

2886 

3133 

3031 

3126 

3133 

3202 

3178 

2939 

3089 

3126 

3133 

3089 

3126 

3076 

3024 

3077 

3133 

3089 

3077 

2906 

2966 

2884 

2792 

3077 

2792 

2844 

3006 

3133 

3048 

2998 

2792 

2844 

2998 

3059 

3068 

3121 

3000 

2998 

3000 

2993 

3140 

3145 

3165 

3067 

3000 

2993 

3067 

3122 

3153 

3113 

3123 

2993 

3067 

3123 

3186 

3205 

3211 

3116 

3067 

3123 

3116 

3025 

3235 

3079 

3050 

3123 

3116 

3050 

2914 

3009 

3009 

2880 

3050 

2880 

2821 

2668 

2822 

2738 

2615 

2880 

2821 

2615 

2135 

2571 

2614 

2499 

2821 

2615 

2499 

2135 

2577 

2570 

2515 

2499 

2515 

2426 

2126 

2636 

2554 

2396 

2515 

2426 

2396 

2069 

2604 

2498 

2380 

•2426 

2396 

2380 

2298 

2760 

2746 

2631 

2396 

2380 

2631 

2667 

3118 

3012 

2871 

2631 

2871 

3114 

2805 

3219 

3171 

3182 

2871 

3114 

3182 

2997 

3218 

3234 

3168 

3114 

3182 

3168 

3014 

3174 

3242 

3162 

3182 

3168 

3162 

2891 

3136 

3114 

3000 

3162 

3000 

2827 

2872 

3138 

2891 

2830 

3000 

2827 

2830 

2930 

3126 

2983 

2904 

2827 

2830 

2904 

3024 

3165 

3048 

2969 

2904 

2969 

2917 

2985 

3153 

3155 

3013 

2969 

2917 

3013 

3131 

3242 

3171 

2931 

2917 

3013 

2931 

3214 

3280 

3259 

3065 

3013 

2931 

3065 

3142 

3271 

3153 

2976 



2931 

3065 

2976 

3032 

3096 

3013 

2955 

2976 

2955 

2901 

2712 

2914 

2768 

2777 

2955 

2901 

2777 

2477 

2704 

2582 

2613 

2777 

2613 

2574 

2490 

2630 

2498 

2561 

2613 

2574 

2561 

2505 

2597 

2542 

2490 

2574 

2561 

2490 

2431 

2633 

2539 

2551 

2561 

2490 

2551 

2679 

2880 

2731 

2329 

2490 

2551 

2329 

2920 

3231 

3012 

2926 

2551 

2329 

2926 

3119 

3240 

3180 

3070 

2926 

3070 

3053 

3018 

3225 

3211 

3098 

3053 

3098 

3034 

2903 

3102 

3091 

3068 

3098 

3034 

3068 

2796 

2963 

2921 

2827 

3034 

3068 

2827 

2841 

3123 

2973 

2874 

3068 

2827 

2874 

2889 

3154 

3041 

3016 

2827 

2874 

3016 

2764 

3159 

3005 

3034 

2874 

3016 

3034 

2758 

3131 

3073 

3033 

3016 

3034 

3033 

2969 

3295 

3107 

3110 

3110 

3001 

3041 

3058 

3223 

3156 

3039 

3001 

3041 

3039 

3004 

3134 

3051 

3093 

3041 

3039 

3093 

2917 

3106 

3006 

2991 

3039 

3093 

2991 

2787 

2994 

2848 

2819 

3093 

2991 

2819 

2633 

2719 

2636 

2707 

2991 

2819 

2707 

2579 

2623 

2577 

2682 

2819 

2707 

2632 

2474 

2674 

2586 

2648 

2707 

2682 

2648 

2473 

2644 

2580 

2615 

2648 

2615 

2583 

2762 

2872 

2760 

2753 

2615 

2583 

2753 

3043 

3191 

3007 

3059 

2583 

2753 

3059 

3242 

3284 

3200 

3059 

2753 

3059 

3059 

3145 

3277 

3201 

3114 

3059 

3059 

3114 

3077 

3369 

3152 

3063 

3059 

3114 

3063 

3016 

3270 

3162 

3082 

3114 

3063 

3082 

2983 

3166 

3004 

3103 

3063 

3082 

3103 

2873 

3112 

2833 

2925 

2925 

2962 

3088 

3054 

3187 

3037 

3039 

2962 

3088 

3039 

3142 

3151 

2967 

3133 

3088 

3039 

3133 

3184 

3167 

3107 

3111 

3039 

3133 

3111 

3287 

3260 

3124 

3167 

3133 

, 3111 

3167 

3304 

3343 

3193 

3338 

3111 

3167 

3328 

3304 

3255 

3186 

3213 

3167 

3338 

3213 

3067 

3177 

2962 

3075 

3213 

3075 

3054 

2790 

2923 

2736 

2974 

3054 

2974 

2837 

2505 

2640 

2587 

2788 

2974 

2837 

2788 

2542 

2643 

2597 

2653 

2837 

2788 

2653 

2540 

2667 

2494 

2648 

2788 

2653 

2648 

2556 

2698 

2527 

2602 

2653 

2648 

2602 

2828 

2885 

2713 

2872 

2648 

2602 

2872 

3199 

3096 

2962 

3121 

2872 

3121 

3203 

3250 

3271 

3130 

3277 

3121 

3208 

3277 

3210 

3353 

3179 

3253 

3277 

3253 

3253 

3049 

3157 

3091 

3199 

3253 

3253 

3199 

2953 

3076 

2881 

2800 

3253 

3199 

2800 

3005 

3119 

2847 

2895 



3199 

2800 

2978 

3070 

3121 

3204 

3307 

3182 

2939 

2738 

2578 

2522 

2406 

2433 

2610 

3003 

3093 

3028 

2978 

2857 
2736 
2972 
3147 
3187 
3124 
3319 
3083 
3051 
3003 
2647 
2576 
2503 
2513 
2734 
2963 
3079 
3126 
2950 
2747 
2823 
3013 
2967 
3021 
3049 
3078 
3007 
2845 

2858 
2719 
2607 
2527 
2687 


2800 2895 
2895 2978 
3070 3121 
3121 3165 
3165 3204 
3307 3182 
3182 3081 
3081 3053 
2890 2738 
2578 2522 
2522 2406 
2406 2459 
2459 2433 
2610 3003 
3003 3107 
3107 3093 
3028 2978 
2978 2857 

2857 2736 
2736 2893 
2893 2972 
3147 3017 
3017 3187 
3124 3319 
3319 3083 

3083 3051 
3051 3003 
3003 2823 
2823 2647 
2604 2576 
2503 2513 
2513 2734 
2734 2963 
2963 3079 
3079 3126 
3126 3084 

3084 3084 
2747 2823 
2823 3013 
3013 2967 
2967 3021 
3021 3049 
3049 3078 
3078 3131 
3131 3007 
2845 2858 

2858 2719 
2719 2607 
2607 2527 
2527 2687 
2687 2463 
2463 2496 


3125 

3229 

3151 

3166 

3193 

3305 

3263 

3293 

3348 

3390 

3144 

3188 

2994 

3004 

2857 

3000 

2644 

2457 

2599 

2463 

2572 

2401 

2583 

2390 

2963 

2629 

3316 

3018 

3299 

3015 

3104 

3071 

3177 

2871 

3043 

2790 

3135 

2947 

3161 

2975 

3188 

2893 

3244 

2887 

3256 

2960 

3306 

2952 

3108 

2898 

3033 

2903 

2903 

2874 

2617 

2615 

2597 

2617 

2584 

2568 

2948 

2712 

3143 

2970 

3298 

2951 

3128 

3023 

3191 

2886 

3178 

2939 

3076 

3024 

3133 

3048 

3068 

3121 

3066 

3103 

3145 

3165 

3153 

3113 

3205 

3211 

3235 

3079 

3009 

3009 

2822 

2738 

2571 

2614 

2577 

2570 

2588 

2522 

2636 

2554 

2604 

2498 

2760 

2746 


3010 2978 

2997 3070 

3101 3165 

3088 3204 

3224 3307 

2977 3081 

2799 3053 

2695 2937 

2496 2578 

2477 2406 

2448 2459 

2475 2433 

2606 2610 

3166 3107 

3161 3093 

3110 3028 

2929 2857 

2847 2736 

2986 2893 

2946 2972 

3068 3147 

3119 3187 

3008 3124 

3172 3083 

2960 3051 

2877 3003 

2786 2823 

2450 2647 

2508 2604 

2404 2503 

2496 2734 

2834 2963 

3031 3079 

3126 3126 

3133 3084 

3089 3084 

3077 2950 

2998 3013 

3000 2967 

2993 3021 

3067 3049 

3123 3078 

3116 3131 

3050 3007 

2880 2845 

2615 2719 

2499 2607 

2515 2527 

2426 2687 

2396 2463 

2380 2496 

2631 2652 



2463 

2889 

3038 

3075 

3136 

2988 

3027 
2828 
3136 
3153 
3226 
3100 
3235 
3129 
3018 
2786 
2568 
2501 
2439 
2438 
2597 
2893 
3091 
3177 
2643 
2661 
2845 
2901 
2940 
2974 

3028 
3149 
2969 
2713 
2597 
2402 
2287 
2274 
2308 
2458 
2779 
2906 
2974 
2880 
2718 
2856 
2942 
2981 
2950 


2496 2652 
3038 3075 
3075 3136 
3136 2988 
2988 3027 

3027 2828 
2828 2958 
2958 3136 
3048 3153 
3226 3100 
3100 3235 
3235 3129 
3129 3018 
3018 2968 

2968 2786 
2568 2572 
2572 2501 
2439 2438 
2438 2597 
2597 2893 
2893 2800 
2800 3091 
3177 2643 
2643 2808 
2808 2661 
2845 2901 
2901 2940 
2940 2922 
2922 2974 

3028 3149 
3149 2969 

2969 2774 
2774 2713 
2597 2402 
2402 2428 
2428 2287 
2274 2308 
2308 2458 
2458 2779 
2779 2948 
2948 2906 
2974 2898 
2898 2880 
2718 2856 
2856 2942 
2942 2981 
2981 2950 
2950 3003 
3003 3017 


3118 

3012 

3218 

3234 

3174 

3242 

3136 

3114 

2953 

2868 

3138 

2891 

3126 

2983 

3165 

3048 

3153 

3155 

3280 

3259 

3271 

3153 

3096 

3013 

3099 

2941 

2914 

2768 

2704 

2582 

2630 

2498 

2597 

2542 

2880 

2731 

3231 

3012 

3240 

3180 

3180 

3240 

3225 

3211 

3102 

3091 

2963 

2921 

3123 

2973 

3159 

3005 

3131 

3073 

3295 

3107 

3209 

3156 

3223 

3156 

3134 

3051 

'3106 

3006 

2994 

2848 

2623 

2577 

2674 

2586 

2644 

2580 

2872 

2760 

3191 

3007 

3284 

3200 

3277 

3201 

3369 

3152 

3166 

3004 

3112 

2833 

3145 

2947 

3187 

3037 

3151 

2967 

3167 

3107 

3260 

3124 

3343 

3193 


2871 28aa 
3168 3136 
3162 2988 

3000 3027 
2827 2828 
2830 2958 
2904 3136 
2969 3048 
3013 3226 
3065 3235 
2976 3129 
2955 3018 
2901 2968 
2777 2786 
2613 2568 
2561 2501 
2490 2439 
2329 2597 
2926 2893 
3070 2800 
3053 3091 
3098 3177 
3068 2808 
2827 2661 
2874 2845 
3034 2940 
3033 2922 

3110 2974 

3001 3028 
3039 2969 
3093 2774 
2991 2713 
2819 2597 
2682 2428 
2648 2287 
2615 2274 
2753 2458 
3059 2779 
3059 2948 
3114 2906 
3063 2974 
3103 2880 
2925 2718 
3088 2942 
3039 2981 
3133 2950 

3111 3003 
3167 3017 
3338 3205 



PREDICTION PATTERNS FOR LOAD FORECASTING 


3hr 

2hr 

Ihr 

3week 

2week 

1week 

output 

3095 

3119 

3008 

3143 

3354 

2945 

3163 

2508 

2437 

2404 

2571 

2611 

2564 

2449 

3089 

3077 

2792 

2917 

3048 

3027 

2844 

3116 

3050 

2880 

2896 

2923 

2905 

2821 

2380 

2631 

2871 

2560 

3229 

3067 

3114 

2830 

2904 

2969 

2988 

3103 

3028 

2917 

2901 

2777 

2613 

2486 

2705 

2536 

2574 

3070 

3053 

3098 

3120 

3125 

3187 

3034 

3033 

3110 

3001 

3059 

3377 

3297 

3041 

3082 

3103 

2925 

2941 

3242 

2847 

2962 

3338 

3213 

3075 

3005 

3069 

2858 

3054 

2602 

2872 

3121 

3293 

3313 

3113 

3208 

2895 

2978 

3070 

3110 

3179 

3022 

3121 

2890 

2738 

2578 

2628 

2459 

2556 

2522 

3107 

3093 

3028 

3146 

2973 

3092 

2978 

3017 

3187 

3124 

3354 

2945 

3163 

3319 

2604 

2576 

2503 

2611 

2564 

2449 

2513 

3084 

2950 

2747 

3048 

3027 

2844 

2823 

2496 

2652 

2889 

3229 

3067 

3114 

3038 

2958 

3136 

3048 

3103 

3028 

2917 

3153 

2968 

2786 

2568 

2705 

2536 

2574 

2572 

2800 

3091 

3177 

3125 

3187 

3034 

2643 

2922 

2974 

3028 

3377 

3297 

3041 

3149 

2428 

2287 

2274 

2672 

2551 

2583 

2308 

2898 

2880 

2718 

3242 

2847 

2962 

2856 


1 



FINANCIAL FORECASTING PATTERNS FILE. 

YEAR{Qtr.! CPI GNP M2SPLY PERWLTH TBILL 


1966(1 St) 

0 1 

42 5 

(2nd) 

0,3 

5 7 

(3rd) 

0 3 

22 5 

(4th) 

0 3 

109 

1967(1st) 

0 3 

12 6 

(2nd) 

0 

134 

(3rd) 

0 3 

32 5 

(4th) 

0 3 

129 

1968(1 St) 

0 3 

26 7 

(2nd) 

04 

39 6 

(3rd) 

0 3 

184 

(4th) 

0 5 

-2 3 

1969(1 St) 

04 

33 5 

(2nd) 

04 

33 

(3rd) 

06 

134 

(4th) 

0 6 

-9 7 

1970(1 St) 

05 

-149 

(2nd) 

0 5 

-2 1 

(3rd) 

06 

29 3 

(4th) 

0 5 

-22 

1971(1st) 

0 5 

64 8 

(2nd) 

03 

-0 2 

(3rd) 

04 

12 7 

(4th) 

0 5 

-0 1 

1972{1st) 

02 

54 6 

(2nd) 

03 

495 

(3rd) 

0 3 

27 

(4th) 

04 

49,2 

1973{1st) 

04 

62 7 

(2nd) 

05 

7 

{3rd) 

1 

-2 7 

(4fh) 

1 

24 5 

1974(1st) 

1 

-50,4 

{2nd) 

1,3 

7.8 

{3rd) 

1 3 

■35 9 

(4th) 

1 6 

-23.9 

1975(1st) 

1 5 

-52,7 

(2nd) 

09 

26 9 

(3rd) 

08 

45 3 

{4th) 

1 2 

37 8 

1976(1 St) 

08 

51 7 

(2nd) 

06 

12 5 

{3rd) 

07 

11.7 

{4th) 

0,9 

28 2 

1977(1 St) 

0.6 

39.2 

{2nd) 

1 

46 7 

(3rd) 

1 3 

59 1 


21.6 321.4 0.39 

22.5 317.8 0.22 

13.4 318.2 0.21 

1 332.6 0.33 

-2.7 339.1 -0.26 

2.1 356 -0.79 

194 369.7 -0.09 

24 2 366 4 0.56 

28 5 378.5 0.36 

16.2 383 2 0.36 

6 7 381.2 0.09 

9 6 394 2 0.03 

8 9 394 2 0 45 

17 1 407.2 0.33 

6 2 406.8 0.46 

-9 420 4 0.54 

-11 1 439.2 0.11 

-9 5 442.2 -0.29 

-14.3 434 2 -0.44 

-9.2 456.4 -0.69 

14 3 449 9 -1,26 

19 3 448 3 -0.58 

32 5 441 8 0,6 

47 8 456 7 0.01 

28 1 454.3 -0.81 

37 451.4 -0.24 

35 4 469.4 0.4 

33 5 462 1 0.55 

42,4 476 2 0.7 

40 4 511.9 0.88 

16 9 506 3 1.38 

-7 4 522 3 0.42 

-68 536,7 -0.4 

-23 569.5 0,41 

-17 548,3 0.34 

-24.1 523.9 -0.47 

-30 528 2 -1.2 

-31,2 543 5 -0.96 

-1 7 507.9 0,23 

46 6 506.3 0.14 

24 9 507.3 -0.69 

13 1 514 4 -0,25 

35,8 509.9 0.11 

39.2 516.4 -0.24 

19.7 517.8 -0.28 

42,6 512.8 0,07 

30 507 0.42 


OUTPUT 

0.22 
0.21 
0.33 
-0.26 
-0.79 
-0 09 
0.56 
0 36 
0.36 
0.09 
0.03 
0.45 
0.33 
0.46 
0.54 
0.11 
-0.29 
-0.44 
-0.69 
-1.26 
-0.58 
0.6 
0.01 
- 0 . 8,1 
-0.24 
0.4 
0.55 
0.7 
0.88 
1.38 
0.42 
-0.4 
0.41 
0.34 
-0.47 
- 1.-2 
-0.96 
0.23 
0.14 
-0.69 
-0.25 
0.11 
-0.24 
-0.28 
0.07 
0.42 
0 . 6 ^ 


1 



(4th) 

1978(1 St) 
(2nd) 
(3rd) 
(4th) 

1979(1st) 

(2nd) 

(3rd) 

(4th) 

1980(1 St) 
(2nd) 
(3rd) 
(4th) 

1981(1st) 

(2nd) 

(3rd) 

(4th) 

1982(1st) 

(2nd) 

(3rd) 

(4th) 

1983(1st) 

(2nd) 

(3rd) 

(4th) 

1984(1st) 

(2nd) 

(3rd) 

(4th) 

1985(1st) 

(2nd) 

(3rd) 

(4th) 

1986(1st) 

(2nd) 

(3rd) 

(4th) 

1987(1st) 

(2nd) 

(3rd) 

(4th) 


0 9 

-7 7 

16 8 

07 

26 4 

20 

1 

95.4 

16.1 

1 6 

26.7 

0.5 

1 6 

39 

-7 5 

1 3 

0 1 

-6 9 

1 7 

-3 

-3 4 

24 

28.7 

-16 3 

2.3 

-6 1 

-22.1 

2.1 

32.1 

-9.1 

3 

-76.4 

-30 

2 9 

2.1 

-43 1 

1 5 

40 1 

-45 3 

2.2 

61 9 

35 3 

2 3 

-10 9 

-8 7 

2 

14 4 

-20.7 

2.6 

-45.6 

5 5 

1.3 

-48.6 

-5.9 

08 

9.5 

16 9 

1 4 

-25 4 

23 9 

1 8 

4 8 

4 3 

02 

27 3 

14 2 

0 

71 7 

37.9 

1 2 

48.1 

95 

1 2 

58.7 

30 3 

0 9 

86 6 

19 

1 1 

46 3 

20.7 

1 1 

22 6 

10 

1 1 

146 

173 

08 

42.3 

14 8 

07 

21 7 

29 3 

1 3 

36 6 

45.1 

0 7 

26 6 

9 9 

1 

58 7 

41 2 

0 2 

-16 5 

14 1 

-0.2 

7 8 

20 3 

08 

21 2 

66 8 

06 

49 4 

50 5 

1.2 

40 5 

39 8 

1 5 

49.3 

5 5 

1 3 

62.8 

-15 5 


518.8 

0.65 

0.47 

537 3 

0.47 

0.17 

537.1 

0.17 

0.46 

553.8 

0 46 

1.1 

560 1 

1.1 

1.02 

578 8 

1 02 

0.34 

593 1 

0.34 

0.14 

601 6 

0 14 

1.22 

598.1 

1.22 

1.91 

597 8 

1.91 

-0.88 

593.6 

-0.88 

-2.11 

597 6 

-2.11 

1 83 

600 7 

1.83 

2.57 

603 6 

2 57 

0.56 

625 9 

0 56 

0.36 

626 3 

0 36 

-1 4 

627 3 

-1 4 

-1.1 

655 1 

-1.1 

0.17 

650 2 

0 17 

-1.59 

629 2 

-1 59 

-2 21 

638 2 

-2 21 

-0 82 

614 1 

-0 82 

0.25 

601 4 

0 25 

0.55 

591 8 

0 55 

0 18 

578 9 

0.18 

-0.03 

558 6 

-0.03 

-0.53 

592 2 

0 53 

0.61 

630 6 

0.61 

-0 43 

611 

-0 43 

-1.08 

632 8 

-1.08 

-0.73 

635 9 

-0.73 

-0.54 

642 8 

-0 54 

-0.18 

637 

-0.18 

-0.11 

597 9 

-0.11 

-0.51 

618 5 

-0,51 

-0,68 

632 5 

-0 68 

-0.39 

651.6 

-0.39 

0 

608 8 

0 

0 19 

620 7 

0.19 

0.25 

633 6 

0 25 

0.13 

614.8 

0.13 

in' 



WINDOW 1-Trajning & Test set Data. 


CPI 

GNP 

M2SPLY 

PERWLTH 

TBILL 

OUTPUT 

0 3 

12.6 

-2.7 

339 1 

-0.26 

-0.79 

0 

134 

2.1 

356- 

-0.79 

-0.09 

0.3 

32.5 

19.4 

369.7 

-0.09 

0.56 

0.3 

12.9 

24.2 

366.4 

0.56 

0.36 

0 3 

26 7 

28 5 

378.5 

0.36 

0.36 

04 

39.6 

16 2 

383.2 

0.36 

0.09 

0 3 

184 

6 7 

381.2 

0 09 

0 03 

05 

-2.3 

9.6 

394 2 

0.03 

0.45 

04 

33 5 

8.9 

394 2 

0.45 

0.33 

04 

3.3 

17 1 

407.2 

0 33 

0.46 

0.6 

13.4 

6.2 

406 8 

0 46 

0.54 

0.6 

-9.7 

-9 

420.4 

0 54 

0.11 

0 5 

-14 9 

-11 1 

439 2 

0.11 

.-0.29 

05 

-2 1 

-9 5 

442.2 

-0 29 

-0.44 

06 

29 3 

-14.3 

434 2 

-0 44 

-0.69 

0 5 

-22 

-9.2 

456.4 

-0.69 

-1.26 

0.5 

64.8 

14 3 

449 9 

-1.26 

-0.58 

0.3 

-0 2 

19.3 

448 3 

-0.58 

0.6 

04 

12 7 

32.5 

441 8 

06 

0.01 

0 5 

-0 1 

47 8 

456 7 

0 01 

-0.81 

0 2 

54 6 

28.1 

454 3 

-0 81 

-0 24 

0 3 

49 5 

37 

451 4 

-0.24 

0.4 


WINDOW 2-Training & Test Set Data. 


CPI 

GNP 

M2SPLY 

PERWLTH 

TBILL 

OUTPUT 

0 3 

26 7 

28 5 

378 5 

0 36 

0.36 

04 

39 6 

16.2 

383.2 

0.36 

0.09 

03 

184 

3 7 

381 2 

0.09 

0.03 

0 5 

-2 3 

9.6 

394.2 

0 03 

0.45 

0.4 

33 5 

8 9 

394 2 

0.45 

0.33 

0.4 

33 

17.1 

407.2 

0.33 

0.46 

06 

134 

6.2 

406.8 

0 46 

0.54 

06 

-9.7 

-9 

420.4 

0.54 

0.11 

0 5 

-14.9 

-11 1 

439 2 

Oil 

-0.29 

0 5 

-2 1 

-9 5 

442 2 

-0 29 

-0.44 

06 

29 3 

-14.3 

434 2 

-0 44 

-0.69 

0.5 

-22 

-9 2 

456.4 

-0.69 

-1.26 

0.5 

64 8 

14.3 

449 9 

-1.26 

-0.58 

0.3 

-0.2 

19.3 

448.3 

-0.58 

0.6 

0.4 

127 

32.5 

441.8 

0.6 

0.01 

0.5 

-0 1 

47 8 

456.7 

0.01 

-0.81 

0.2 

54.6 

28.1 

454.3 

-0.81 

-0.24 

0 3 

49 5 

37 

451 4 

-0.24 

04 

0.3 

27 

35.4 

469.4 

0.4 

0.55 

0.4 

49.2 

33.5 

462.1 

0.55 

0.7 

0.4 

62.7 

42.4 

476.2 

0.7 

0.88 

0.5 

7 

40 4 

511.9 

0.88 

1.38 



127829 





